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REMARKS 

This communication is in response to the Office Action 
mailed on November 15, 2005 and response to the telephone 
interview that occurred on Thursday, January 12, 2006 at 2:00pm 
est- The examiner is thanked for his time and helpful comments 
during the interview- In the Office Action, claims 1-44 were 
pending of which all were rejected. 

The Office Action reports that claims 20, 33, and 40 
were objected to under 37 C.F.R. 1.75(c) as being of improper 
dependent form. Claims 20, 33, and 40 have been amended in a 
manner believed to place the dependent claims in proper form- 

The Office Action next reports that claims 1-8, 14, 20, 
and 34-44 were rejected under 35 U.S.C. §103 (a) as being 
unpatentable over U.S. Patent No. 5,828,991 to Skeina et al. 
(hereinafter Skeina) in view of U.S. Patent No. 5,953,541 to King 
et al. (hereinafter King) 

Claim 1 has been amended to recite a method for 
determining a word entered using a reduced keypad, where each of 
one or more keys of the reduced keypad is mapped to a plurality 
Of letters, the method comprising: receiving key input 
corresponding to the entered word and at least one of a left 
context and a right context; determining a list of possible words 
corresponding to the key input for the entered word, wherein each 
listed word is in a vocabulary or previously entered into a 
cache ; using a language model comprising probability values 
corresponding to sequences of word N-grams of a natural language 
to rank the listed words based on at least one of the left 
context and the right context of the key input; and updating the 
language model with additional training using words entered into 
the cache * [emphasis added] 

The amendments to claim 1 clarify that each word on the 
list of possible words that, correspo**"! TT ith the key input is in $ 
vocabulary or vocabulary list or har r>^n previously entered into 



PAGE 13/18 1 RCVD AT 1/17/2006 3:56:08 PM [Eastern Standard TlmeJ* SVR:USPTO-EFXRF-6/26 * Of n s : 2738300 * CSIO:61233i3312 * DURATION (mm-s$):0444 



01/17/2006 14:57 FAX 61 23'343312' 



WESTMAN CHAiXPUN & KELLY 



©014 



-13- 

the cache, typically by a user. As discussed in the interview, 
the amendment further clarifies that the language model includes 
probability values that correspond vith sequences of word N-grams 
of a natural language . Further, the amendments to claim 1 clarify 
that the language model used to rank the list of possible words 
is u pdated using words previo usly entered into the cache . TITus, 
as discussed in the interview, the language model of the present 
inventions can be initially trained based on a large, fixed 
training corpus but later updated based on words previously 
entered into the cache. It is noted that both words previously 
entered into a cache and their respective occurrences could be 
used to updaXe__^he^ languag e ^m odej.,.. 

As discussed in the interview, it is believed that 
updating the language model using worda previously entered into 
the cache is advantageous over a language model constructed using 
a fixed corpus that is not updated based on words entered into a 
cache because individual users c*n have propensities to use 
certain words more or less frequently than is typical. Also, 
users can be engaged in particular fields of endeavor such as 
engineering or sports. In these fields of endeavor, users 
typically use certain words more or less frequently than may 
occur in a fixed training corpus of a particular natural 
language. Thus, as discussed in t) ^ interview, it is believed 
that updating the language model u~ing words previously entered 
into a cache as recited in claim 1 cm result in a language model 
having increased accuracy such as for particular users or for 
particular fields of endeavor. 

Skiena discloses a system and method of reconstructing 
sentences entered using a reduced keyboard such as a telephone 
keypad using word ambiguity resolu + *on. However, it is believed 
that Skiena does not teach or so —st all of the features of 
. claim 1. For example, it is believe that Skien a does not include 
updating __a langua ge model yairiry T,^rHr ..prpvi^naiy entered into a 
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cache as recited in claim 1. Instead, as emphasized in the 
interview it is believed that Ski ^na's word and word pair ^ 
frequencies are determined using a large, fixed corpus (abstract) ^J> 
rather than a language model that is updated based on words 
entered into a cache. For example, Skiena disclose the "Brown" 
corpus as one possible corpus. (Col. 6, lines 46-49) 

The Office Action states that Skiena does not 
specifically suggest the ability to train language data based on 
words entered into a cache. However, the Office Action contends 
that King teaches such a language d.rt-a training method at Col. 
16, lines 44-56 and Col. 26, line:? 5-49* It is respectfully 
observed that if Skiena or other prior art do not suggest 
training a language model based on w<^rds previously entered into 
a cache, then it would not be obvious to modify Skiena with such 
a feature- For illustration, the MPEP provides in part, 

Obviousness can only be established by combining or 
modifying the teachings of th^ x ^ior art to produce 
the claimed invention where th're is some teaching, 
suggestion, or motivation to r J o so found either ^ cu^*s*~ 

explicitly or implicitly in the references themselves r 0 S 5* 

or in the knowledge generally available to one of / — v x K^'O 
ordinary skill in the art. [MPF.~ 2143.01] * 

It is believed that the Office Act! - does not point out such a 
teaching, suggestion, or motivation 1 1 combine Steina and King as 
proposed. Tlvis, the applicants resp^- "ully request withdrawal of 
the above obviousness rejection. 

Further, as discussed in t ■- previous amendment, it is 
believed th^t the Skiena system ar :rethod requires that the 
entire sent mce be entered first *ith symbols placed between 
words in or* J er segment individual v rds . (See FIGS. 3 and 7) A 
word trellis or lattice is apparen' y constructed with possible 
words or. tn' ^ns corresponding to r -h entered word, (abstract) 
Paths thm h the lattice repre t possible sentence re- 
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constructions, (abstract) A Viterbi a 
or select paths based on probability. 

Importantly, as discussed 
believed that Skiena discloses th^ 4 
rejected by labeling each possible vor 
grammatical word category or part o 
verb. (FIG, 8, Col. 9, line 64 to Col. 
that bigram frequencies for these gr 
calculate transitional prtfSaJDiiT^ 
probabilities are considered by 
determining probable paths throi< 
constructing grammatically plausible 
lines 12-19) 

The Office Action refers 4 
contend that Skiena discloses using ^ 
listed words based on one or more 
context, and the right context; of 
referred to section states: 



■ gorithm is used to decode 
(Col. 9, lines 9-11) 
in the interview, it is 
implausible sentences be 
with a tag representing a 
speech, such as noun or 
10, line 2) It is believed 



-^T ftatical tags are used to 
T~! These transitional 

v e viterbi algorithm in 
the lattice based on 

word sequences. (Col- 10 , 

o Col. 11, lines 30-47 to 
1 ^nguage model to rank the 
• • at least one of the left 
i key input. However, the 



[Al stored language rule set r- ■• 
in the selected language [is 
probability values for sequenc * : 
choices for such word position 
ono word choice for an adjacer* 
sentence structure, the lang^ : 
rules in one of the followir 
based on transitional probabilj. 
word sequences, and (ii) rules 
relative positioning of word 
categories in a sentence struct 
401 



esentative of usage 
4 ili zed] to derive 

: of individual word 
nlative to at least 

vord position in the 
rule set including 
tegories (i) rules 
*f use of particular 
?d on probability of 
■■>f particular word 
[Col. 11, lines 32- 



Thus, It is believed that the proh.** 
based on g rammatical sequence s s 

pro bability v alues corresponding t 

am" 01 w h-\ is" * that are found i 
English . 



ities values of Skiena are 
as <-*rioun> <verb> and not 
ue. -es of words such as W I 



na tural languag e such as 
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ion refers to secondary 
: teaches a language data 
-ered into a cache- King 
i ambiguous input sequences 
vith the generated input 

In 



Further, the Office 
reference King to contend that K 
training method based on words e 
discloses a system for disambiguate 
by displaying ob j ects associated 

sequences in the order of decree «-ing frequency of use, 
particular, the Office Action pointr to Col. 16, lines 44-56 and 
Col. 26, lines 5-49 as disclose— the above language data 
training method feature . 

Claim 1, as amended, rn ; t-.es updating the language 
model with additional training u~'-g words entered into the 
cache. It is believed that King d s not include updating the 
language model using words entered * nto a cache as recited in 
claim 1. Instead, it is believed * hat King creates a custom 
vocabulary from words previously ^>^ted but does not use such 
w ords for updating the language mo$U\ with additional training as 
recited in claim 1. 



e examiner suggested the 
ited to N-qram sequences of 
d art. The examiner and the 
a few possible ways to use 
^1 feature. In the present 
language model comprising 
-guences of word N-grams of 
1} It is believed that the 



During the interview, 
language model feature be further 
words to further clarify over the r 
appli«tnt' s representative discus rv 
the term "N-gram" in the language 
amendment, claim 1 recites "usi^ - 
probability values corresponding t- 
a natural language . . [emphasis ? 
above recitation of "N-gram" conf^^-s to the suggestion of the 
examiner made during the interview 

In light of the forego!' 
is patentable over the cited art. 
and ana believed to be separately 
allowance of claims 1-20 are respr 

Claim 21 has been amerd 
1- Remarks relating to rlaim 



t is believed that claim 1 
iras 2-2 0 depend on claim 1 
table. Reconsideration and 
'■ ly requested. 

a r q nner similar to claim 
e herein incorporated by 
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reference- Thus, claim 21 is belie^.d to be patentable over the 
cited art. Claims 22-26 depend on c;aim 1 and are believed to be 
separately patentable. Reconsideration and allowance of claims 
21-26 are respectfully requested. 

Further, claim 27 has beer, amended similar to claim 1, 
Therefore, the above remarks relatinq to claim 1 are incorporated 
herein. Further, claim 27 also include smoothing and pruning the 
language model, which is important in addressing inaccuracies 
associated with sparse data. In 1-iht of the foregoing, it is 
believe-d that claim 27 is patentab - over the cited art. Claims 
28-33 depend on claim 27 and are believed to be separately 
patentable- Reconsideration and allowance of claims 27-33 are 
respect. fully requested. 

Finally, claim 34 has a 1 -o been amended in a manner 
similar to claim 1 but further clar< fi.es that a user enters words 
into a cache. Remarks relating + ^ claim 1 are incorporated 
herein. Thus, in light of the f r ■ Toing, it is believed that 
claim 34 is patentable over the ci f 
claim 34 and are believed to 

Reconsideration and allowance of 

r 

requested. 

The Director is authorize 
required by this paper or credi 1 
Account No. 23-1123. 

Respectfully sr 



art. Claims 35-44 depend on 
be separately patentable . 
ims 34-44 are respectfully 

to charge any fee deficiency 
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